Video content selection

ABSTRACT

A method and apparatus are disclosed for detecting a user selection of a positioning tag; retrieving directional information and timestamp information relating to the selected tag; comparing directional information relating to the selected tag with directional information of an array of cameras arranged to capture video content from a recording area; identifying video content captured by one or more cameras from an array of cameras arranged to capture video content from a recording area, wherein the video content captured by the one or more cameras is identified if the one or more cameras have captured video content from a section of the recording area relevant to the location of the selected tag over a time period relevant to the timestamp information relating to the selected tag; and selecting the identified video content obtained from the one or more cameras for display.

RELATED APPLICATION

This application was originally filed as PCT Application No.PCT/FI2015/050633 filed Sep. 23, 2015.

FIELD

The specification relates to selection of recorded video content.

BACKGROUND

In the field of audio/video recording and editing it is often necessaryto handle files that are relatively large in terms of data size. Aparticular issue arises where audio/video content is obtained from anarray of recording devices leading to even greater quantities of data.This brings new challenges in relation to managing the large quantitiesof data in a reliable, efficient and user-friendly manner.

SUMMARY

In a first aspect, this specification describes a method comprisingdetecting a user selection of a positioning tag; retrieving directionalinformation and timestamp information relating to the selected tag;comparing directional information relating to the selected tag withdirectional information of an array of cameras arranged to capture videocontent from a recording area; identifying video content captured by oneor more cameras from an array of cameras arranged to capture videocontent from a recording area, wherein the video content captured by theone or more cameras is identified if the one or more cameras havecaptured video content from a section of the recording area relevant tothe location of the selected tag over a time period relevant to thetimestamp information relating to the selected tag; and selecting theidentified video content obtained from the one or more cameras fordisplay.

The selected part of the captured video content may comprise videocontent obtained from a camera arranged to cover an area in which thetag is determined to be located.

The selected part of the captured video content may comprise videocontent obtained from a camera adjacent to the camera arranged to coveran area in which the tag is determined to be located.

The method may further comprise increasing a bit rate allocated to theselected part of the captured video content.

The method may further comprise decreasing a bit rate allocated to theremainder of the captured video content.

The directional information and timestamp information may be stored in afile separate from the captured video content.

Identifying one or more cameras comprises identifying one or more pairsof stereoscopic cameras.

The method may further comprise retrieving the selected video contentfrom one of: a recording device, a replay device or a remote server.

The method may further comprise causing a part of the captured videocontent comprising video content obtained from the one or moreidentified cameras to be displayed.

Detecting a user selection of a positioning tag may comprise detecting auser selection of a plurality of positioning tags.

The method may further comprise causing parts of the captured videocontent comprising video content obtained from the cameras correspondingto the plurality of positioning tags to be displayed in a split-screenformat.

The video content captured by each camera is recorded as part of acomposite data file or in an individual file.

The directional information may comprise an azimuthal angle.

The directional information may comprise an elevational angle.

In a second aspect, this specification describes a computer programcomprising instructions that, when executed by a computing apparatus,cause the computing apparatus to perform the method of the first aspect.

In a third aspect, this specification describes an apparatus comprising:at least one processor; at least one memory having computer-readableinstructions stored thereon, the computer-readable instructions whenexecuted by the at least one processor causing the apparatus at leastto: detect a user selection of a positioning tag; retrieve directionalinformation and timestamp information relating to the selected tag;compare directional information relating to the selected tag withdirectional information of an array of cameras arranged to capture videocontent from a recording area; identify video content captured by one ormore cameras from an array of cameras arranged to capture video contentfrom a recording area, wherein the video content captured by the one ormore cameras is identified if the one or more cameras have capturedvideo content from a section of the recording area relevant to thelocation of the selected tag over a time period relevant to thetimestamp information relating to the selected tag; and select theidentified video content obtained from the one or more cameras fordisplay.

In a fourth aspect, this specification describes a computer-readablemedium having computer-readable code stored thereon, thecomputer-readable code, when executed by at least one processor, causingperformance of: detecting a user selection of a positioning tag;retrieving directional information and timestamp information relating tothe selected tag; comparing directional information relating to theselected tag with directional information of an array of camerasarranged to capture video content from a recording area; identifyingvideo content captured by one or more cameras from an array of camerasarranged to capture video content from a recording area, wherein thevideo content captured by the one or more cameras is identified if theone or more cameras have captured video content from a section of therecording area relevant to the location of the selected tag over a timeperiod relevant to the timestamp information relating to the selectedtag; and selecting the identified video content obtained from the one ormore cameras for display.

In a fifth aspect, this specification describes an apparatus comprising:means for detecting a user selection of a positioning tag; means forretrieving directional information and timestamp information relating tothe selected tag; means for comparing directional information relatingto the selected tag with directional information of an array of camerasarranged to capture video content from a recording area; means foridentifying video content captured by one or more cameras from an arrayof cameras arranged to capture video content from a recording area,wherein the video content captured by the one or more cameras isidentified if the one or more cameras have captured video content from asection of the recording area relevant to the location of the selectedtag over a time period relevant to the timestamp information relating tothe selected tag; and means for selecting the identified video contentobtained from the one or more cameras for display.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the methods, apparatuses andcomputer-readable instructions described herein, reference is now madeto the following descriptions taken in connection with the accompanyingdrawings in which:

FIG. 1 illustrates a recording environment;

FIG. 2 is a schematic diagram illustrating a recording apparatus and anediting/replay apparatus;

FIG. 3 is a schematic diagram of a controller;

FIG. 4 is a schematic diagram of a camera;

FIG. 5 is a schematic diagram of a mobile tag;

FIG. 6 is a flow chart illustrating a flow chart showing steps taken ata recording apparatus;

FIG. 7 is a flow chart illustrating a flow chart showing steps taken ata replay apparatus;

FIG. 8 shows a storage medium;

FIG. 9 shows a camera array according to an alternative embodiment; and

FIG. 10 shows a camera array according to an alternative embodiment.

DETAILED DESCRIPTION

Embodiments of the invention provide a system for capturing video and/oraudio across an array of recording devices as well as capturingdirectional data relating to positioning tags that are within the fieldof view of the recording devices. The directional data may be usedduring at least one of a subsequent video processing/editing stage sothat multiple streams captured by the array of recording devices can behandled in an efficient way. Furthermore, when a video is subsequentlyviewed by a viewer, certain views may be highlighted as part of thevideo based on the relative location measured from the positioning tag'swireless transmissions.

Embodiments of the invention involve recording the relative locations ofradio-detected objects and associating the locations with an areacaptured in the video and/or audio data. A record of the direction radioinformation may be added to a video and/or audio recording file.Alternatively, a separate file may be recorded containing thedirectional radio information and time-stamped so that it matches withthe simultaneously recorded video and/or audio files.

FIG. 1 shows an example recording environment 1. A recording apparatus10 comprises a spherical array of video cameras 11 and a chassis. Whilereferred to as a recording apparatus, the apparatus is arranged tocapture a live video stream as well as recording video content to bestored at a storage medium. In embodiments, where the video content isstored, it can be stored at the recording apparatus itself, at a videoediting computer or at a remote server. The video cameras 11 arearranged to provide video coverage across 360 degrees in terms of bothelevation and azimuth, i.e. across an entire sphere, which may be termeda video sphere. It should be borne in mind that in alternativeembodiments, an array may comprise cameras covering a hemispherical areaor indeed only a section of a spherical area.

Each of the cameras 11 is arranged to capture a section of thethree-dimensional space surrounding the camera array 10. The recordingapparatus 10 shown in FIG. 1 has six cameras 11 a-f. Camera 11 f is notshown in FIG. 1 but is represented schematically in FIG. 2.

A positioning tag 20 (for example a Bluetooth Low Energy tag) is shownin FIG. 1. In this example, the positioning tag 20 is part of a user'swatch. In other non-limiting examples the positioning tag 20 may beattached to an animal's collar to help capture video for a wildlifedocumentary or the positioning tag 20 may be incorporated in a mobilephone or a key fob.

The recording apparatus 10 and positioning tags 20 may be configured tooperate using any suitable type of wireless transmission/receptiontechnology. Suitable types of technology include, but are not limited toBluetooth Basic Rate/Enhanced Data Rate (BR/EDR) and Bluetooth LowEnergy (BLE). Bluetooth Low Energy (BLE) is a relatively new wirelesscommunication technology published by the Bluetooth SIG as a componentof Bluetooth Core Specification Version 4.0. Other types of suitabletechnology include for example technologies based on IEEE 802.11 andIEEE 802.15.4. The use of BLE may be particularly useful due to itsrelatively low energy consumption and because most mobile phones andother portable electronic devices will be capable of communicating usingBLE technology.

Signals/positioning packets transmitted by the positioning tags 20 maybe according to the High Accuracy Indoor Positioning (HAIP) solution forexample as described at http://www.in-location-alliance.com.

Whilst embodiments are described herein using BLE messages and HAIPsystems, alterative low-power radio technologies may be used such asIEEE 802.15.4.

The recording apparatus 10 may be considered the origin of a sphericalcoordinate system. The positioning tag 20 may thus be defined by anazimuthal angle θ in the x-y plane shown in FIG. 1 and by an elevationalangle φ with respect to the z axis. As will be explained in more detailbelow, the positioning tag 20 periodically transmits wireless messageswhich are received by the recording apparatus 10. The recordingapparatus 10 then determines an azimuthal angle of arrival and anelevational angle of arrival for the received packet. The recordingapparatus 10 may also determine a received signal strength indication(RSSI) value for the received package. This information may then bestored in a suitable format.

FIG. 2 is a schematic diagram of the recording apparatus 10 and editingand/or replay apparatus 15. The recording apparatus 10 comprises acontroller 13. The controller 13 controls the recording apparatus 10.The controller 13 is configured to determine angle-of-arrivalinformation from packets received from the tags 20.

In the example implementation shown in FIG. 2, the controller 13 ismounted in the centre of the video/audio recording system. In thisembodiment, there are six cameras, each having one lens, and a singlecontroller 13. The output of the camera recording is saved into one ormore files in raw or processed format stored by the controller 13. Theoutput of each individual camera may be stored in a respective filestored by the controller 13. Alternatively, the output of the camerasmay be combined into a single, composite file stored by the controller13. Also, the directional data is saved into one or more files in a rawor processed format. The video and directional data may be storedlocally at the recording apparatus 10 or separately, such as in a remoteserver 170, to be accessed remotely by the replay apparatus 15.Alternatively the recorded media and directional data may be uploaded tothe replay apparatus 15 itself.

The recording apparatus 10 may comprise a communication module 14. Thecommunication module 14 comprises an RF antenna and RF transceiver toallow wireless communication between the recording apparatus 10 and aremote server 170 or computer 15 having a video-editing capability. Therecording apparatus 10 may be configured to communicate via a wirelessnetwork such as Wi-Fi. Alternatively, the recording apparatus 10 mayhave a wired link (not shown) to a computer having a video-editingcapability.

The recording apparatus 10 may be provided with a user input/output 12.The user input/output 12 may comprise a screen and keyboard which may beintegrated into a touchscreen. The user input/output 12 is used to allowthe user to control the operation one or more of the cameras 11 and theplayback functionality of the recording apparatus 10. The userinput/output 12 allows the user to control playback from selected one ormore cameras. As described below with reference to FIG. 7, a user mayselect one or more tags 20 from a user interface displayed on the screenof the apparatus 10. Selection of parts of the video content relevant tothe tag location may then be performed at the apparatus 10.

The screen may be used for viewing live footage from one or morecameras. A user may select one or more tags 20 and view live footagefrom the cameras that are relevant to the selected tags. The selectedvideo content may be stored at the apparatus 10, the replay apparatus 15or the remote server 170.

The editing and/or replay apparatus 15 may be a computer comprising aprocessor 150 and a storage device 151. The storage device 151 comprisesa volatile memory 152 and a non-volatile memory 153. The non-volatilememory 153 may have an operating system 154 and video editing software155 stored therein. The non-volatile memory 153 may also store adirectional data file 156 in which the directional data received fromthe controller 13 is stored. A video file 157 may also be storedcontaining video stream data received from the controller 13.Alternatively, the video file may be stored at the remote server 170.The video stream data may be stored as separate files, whereby eachvideo file contains the output of each respective camera. Alternatively,the directional data may be contained within the video file(s). Theediting and/or replay apparatus 15 further comprises an RF transceiver158 and an RF antenna 159 to enable wireless communication with the,recording apparatus 10 and the server 170. The replay apparatus 15 maybe a computer having input and output components 160 such as a screen,keyboard and speakers and so forth. A user may view video content fromthe recording apparatus as a live stream received from the recordingapparatus 10. Alternatively, the video content may be stored at thereplay apparatus 15 or the remote server 170 for playback.

FIG. 3 is an example schematic block diagram of the controller 13. Thecontroller 13 comprises a processor 300 and storage device 310. Thestorage device 310 comprises non-volatile memory 320 on whichcomputer-readable code 320A is stored. The non-volatile memory isprovided with a Bluetooth module 320B. The computer-readable code 320Aallows the particular functionality of the controller 13 in embodimentsof the present invention to be stored and executed. The Bluetooth module320B contains the code required so that received Bluetooth messages maybe processed in accordance with the Bluetooth standard. The storagedevice 310 also comprises a volatile memory 330.

The processor 300 is arranged to process azimuthal and elevationalangle-of-arrival information. The processor 300 may apply directionaldata to the video feed obtained from one or more cameras. Alternatively,the processor 300 may output the directional data and the video feedobtained from one or more cameras to a remote server.

The controller 13 comprises an azimuthal antenna array 340 connected toan RF switch 341, a transceiver 342 and an azimuthal angle-of-arrival(AoA) estimation module 343. The controller 13 also comprises anelevational antenna array 350 connected to an RF switch 351, atransceiver 352 and an elevational angle-of-arrival (AoA) estimationmodule 353.

The estimation of the Angle of Arrival is based on a measured timedifference of signal copies (transmitted by the multiple physicallyseparated antennas) in the receiver. The time difference is due tovariable propagation channel lengths, and the practical estimation istypically based on secondary effects to the signal, such as theresulting phase difference of the signal copies. Angle of Arrivalpositioning has been shown to provide positioning accuracy of tens ofcentimeters, or in about 2 degree direction estimate.

The link between the processor 300 and the antennas 340, 350 may bebidirectional so that the transceivers 342, 352 and antennas 340, 350may also be used for RF communication.

The controller 13 also comprises a dock 360 and timestamping capability.The controller 13 may be configured to measure and record RSSI data ofreceived packets.

The controller 13 may store reference values to allow the azimuthal andelevational angles to be monitored uniformly. The storage device 310 maystore information defining the bearing of zero degrees in azimuth andelevation. From these reference points, the area covered by a particularcamera may be defined. For example, camera 11 a may be defined ascovering azimuthal angular range 0 degrees to 60 degrees and elevationalangular range 0 degrees to 60 degrees. The cameras 11 and controller 13may form an integrated recording apparatus 10 wherein the bearinginformation is stored in the memory of the cameras 11 and/or controller13. In alternative embodiments, the cameras 11 and/or controller 13 maybe provided with a compass to determine direction and/or a gyroscope todetermine orientation.

FIG. 4 is a schematic block diagram of one of the cameras 11. The camera11 comprises a camera module 400. The camera module 400 comprises videocamera components that are known in the art including, for example alens, a CCD array and an image processor. Each camera 11 may becontrolled by the controller 13. In some embodiments, the camera 11receives instructions from the communication module 14 which, in turn,receives instructions wirelessly from the video-editing computer.Alternatively, each camera 11 may be provided with an RF antenna andtransceiver so that each controller receives instructions directly fromand is controlled by the video-editing computer. The camera 11 alsocomprises a processor 402 and storage device 403. The storage devicecomprises non-volatile memory 404 and volatile memory 405. Thenon-volatile memory is provided with computer-readable instructions404A. The camera may also be provided with a clock 405 so that atimeline may be applied to the recorded video content. The clocks ofeach of the cameras may be synchronised by the controller 13 to ensurethat consistent timekeeping is applied. The camera 11 may also comprisea microphone 406 to capture audio content. The cameras may compriseseparate video and audio processors. Alternatively, the video and audioprocessing capability may be combined in a single multimedia processoror, as shown in FIG. 4, the processing functionality of the cameramodule 400 and microphone 406 may be performed by the processor 402.

FIG. 5 is a schematic block diagram of the positioning tag 20. Thepositioning tag 20 comprises a transceiver 200 for transmitting wirelessmessages such as BLE advertisement messages and an antenna 201. Thepositioning tag 20 also comprises a processor 210 and a storage device222. The storage device comprises non-volatile memory 220 and volatilememory 221. The non-volatile memory is provided with a Bluetooth module220A and programming instructions 220B. The programming instructions220B allow the particular functionality of the positioning tags 20 inembodiments of the present invention to be stored and executed. TheBluetooth module 220A contains the code required so that messages may betransmitted in accordance with the Bluetooth standard.

In some embodiments the positioning tag 20 may form a component of amobile communication device such as a mobile phone, smart watch,electronic glasses etc. In this case, the mobile communication devicemay comprise an input 230 allowing a user to input additionalinformation to be included in the wireless messages. For example, a usermay include their name. Another example, where the positioning tag 20 isincluded as part of a smart watch or mobile phone is that a user mayrecord their heartbeat which is then transmitted as a data field in thewireless message such as BLE advertisement messages.

FIG. 6 is a flow chart illustrating operations of the recordingapparatus 10 as a video is recorded.

At operation 6.1, the controller 13 may optionally collect informationfrom positioning devices 20 in the vicinity of the recording apparatus10. Positioning devices may send wireless messages containing sensordata advising the recording apparatus 10 of the presence of thepositioning devices 20 in the vicinity. The wireless messages maycontain sensor information about the positioning devices 20. Sensorinformation may include, for example, the identity of the user of thedevice, whether the device attached to the user (e.g. as a smart watch,electronic glasses etc). The collection of the sensor data viaconnection with the positioning devices 20 may also happen during therecording or after the recording.

There may also be multiple radio transceivers or capability for multipleconnections in the controller 13, so that for example heart rateinformation of a competitor person can be recorded along taking video.The additional data may be saved into the same file as the directionalor into separate file(s). An advantage of a separate file is fastersearch. Search may be based, for example, on searching records relatedwith a particular identity only.

At operation 6.2, recording is commenced. The instruction to commencerecording may be inputted at a computer that is in wirelesscommunication with the recording apparatus 10. Alternatively, therecording apparatus 10 may comprise input capability such as a recordbutton, touchscreen and so forth. Video may be recorded by each of thecameras 11 for the entire sphere shown in FIG. 1. The video may bestored in a video file format such as .wmv, .mov or .mpeg or any othersuitable format. The audio data may be recorded within the same datafile as the video or in separate files. Examples of audio file formatsare .wav and .mp3 although any other suitable file format may be used.

At operation 6.3, the recording apparatus 10 receives a wireless messagefrom a positioning tag such as the positioning tag 20 shown in FIG. 1.The wireless message may contain an identifier to identify thepositioning tag that sent the packet. The wireless message may alsocontain further fields such as text. For example, a message may containheartbeat information obtained by the positioning tag 20.

At operation 6.4, the azimuthal and/or elevational Angles of Arrival aredetermined. Direction estimation of the signal source from the receivedsignal is performed by using multiple antenna elements. The estimationof the azimuthal and elevational Angle of Arrival is based on measuredtime difference of signal copies (received by the multiple physicallyseparated antenna elements 340, 350 shown in FIG. 3) in the controller13. The time difference is due to variable propagation channel lengths,and the practical estimation is typically based on secondary effects tothe signal, such as the resulting phase difference of the signal copies.

The positioning tag 20 transmits a wireless message and the controller13 executes antenna switching during the reception of the packet. Thecontroller 13 scans for the wireless messages and executes amplitude andphase sampling during reception of the packets. The controller 13 maythen utilise the amplitude and phase samples, along with its own antennaarray information, to estimate the AoA of the packet from thepositioning tag 20.

Operation 6.5 is an optional step. The RSSI value of the received packetis determined and recorded. At operation 6.6, the received packet istime stamped. At operation 6.7, the data obtained at operations 6.4, 6.5and 6.6 are stored. The data may be stored as part of the video file.Alternatively, the data may be stored in a separate file. Storing thedata separately is advantageous since it is not reliant on video formatsthat support adding the data to video file metadata.

Table 1 shows an example of the contents of a directional data file.

Azimuth Time Elevation angle angle Identity RSSI Data 00:00:134 176°281°  00:01:02:03:04:05 −73 dBm 01:22:34:56 00:01:023 183°  32 

00:01:02:03:04:05 −76 dBm 01:22:34:56 00:01:345 70° 355 

11:01:02:03:04:05 −50 dBm 01:22:34:57 00:02:576 165° 101 

00:01:02:03:04:05 −73 dBm 01:22:34:56 00:03:258 163°  23 

00:01:02:03:04:05 −67 dBm 01:22:34:56 00:03:753 65° 174 

11:01:02:03:04:05 −54 dBm 01:22:34:57 00:03:915 3° 110 

22:01:02:03:04:05 −88 dBm 01:22:34:58 00:04:097 154° 303 

00:01:02:03:04:05 −79 dBm 01:22:34:56 00:04:349 61° 224 

11:01:02:03:04:05 −56 dBm 01:22:34:57 00:04:436 7° 197 

22:01:02:03:04:05 −82 dBm 01:22:34:58

The example directional data comprises an identifier of the transmitterof the detected directional signals (i.e. the positioning tag 20), themeasured azimuthal and elevational angles and RSSI values. Each angleand corresponding RSSI value is associated with a time stamp. The timestamp applied to the received directional data packet corresponds to thevideo recording so that the observed tag can be matched with the videostream.

The file contents shown in Table 1 illustrate embodiments where wirelessmessages received from tags 20 positioned anywhere within the sphericalspace surrounding the recording apparatus 10 (i.e. from 0 to 360 degreesin both azimuth and elevation) are recorded in a single file. This maybe the case where a single controller 13 is used in connection with eachcamera 11. In other embodiments, each camera 11 may be connected to arespective controller 13 and a file containing data relating to tagdetection events in the sector recorded by the camera may be maintainedat each controller. Alternatively, a single file containing datarelating to tag detection may be compiled by a central processor (suchas the video editing computer) based on files of tag data relating toeach sector of the spherical space surrounding the recording apparatus10.

The directional information from controller and the camera informationare recorded so that transmitters can be placed into the combined camerarecording (360 degree recording). The controller may collect data fromall or the subset of the received packets.

The link between the portions of the video/audio data and thedirectional data may be based on setting a relationship between thedirectional radio sphere and the video/audio recording sphere to match.Each camera records a certain part of the video sphere—the parts ofsphere the cameras cover may be overlapping. In various embodiments, thecameras are arranged so there are no gaps in coverage. The part of thesphere that a camera covers is matched with certain part of theradio/directional sphere. When the desired radio transmitter is detectedon certain azimuth and elevation angles, the correspondingcamera/cameras can be switch on or their focus can be adjusted accordingto the radio/directional detection.

FIG. 7 shows the operations performed when a user wishes to replay andedit video content. The video content may be being live-streamed on ascreen of the recording apparatus 10, in which case, the following stepsshown in FIG. 7 are performed at the recording apparatus 10.Alternatively, the video content may be being live-streamed on a screenof the replay apparatus 15 in which case, the following steps shown inFIG. 7 are performed at the replay apparatus 15.

In alternative embodiments, the content may be stored locally at thereplay apparatus 15, at the recording apparatus 10 or at the remoteserver 170 for playback subsequent to the recording of the videocontent. The selected video content may be played back on the replayapparatus 15 or at the recording device 10.

In this example, the recording apparatus 10 has captured video contentacross a spherical recording area. The resulting data size of a videostream containing video content from the array of cameras shown in FIG.1 can be very large. During the replay and editing stages, a user maychoose to watch video based on a direction of the particular tag. Bymatching the video content captured from the various cameras with thedirectional data relating to the tags of interest, the amount of videodata that needs to be handled can be reduced.

At operation 7.1, a user selects one or more positioning tags 20 that heor she wants to track during playback of the video content. This may bedone in a number of ways. For example, the user may be presented with auser interface in which a list of tags is displayed. The tags that areselected for display may be obtained from the directional data file 156which contains the tag identifiers, displayed to the user who thenselects at least one tag to track.

At operation 7.2, the replay apparatus 15 or recording apparatus 10searches the directional data file 156 for the directional data and timestamp data relating to the selected positioning tags 20. The directionaldata and time stamp data relating to the selected positioning tags 20are retrieved.

At operation 7.3, the replay apparatus 15 compares the directional dataof the selected tag 20 with directional information regarding each ofthe cameras 11. At operation 7.4, one or more cameras are identifiedthat have recorded video content from a section of the sphericalrecording area that corresponds to the location of the selected tag.

At operation 7.5, part of the video content is selected containing thevideo content from the identified one or more cameras and the videocontent from the one or more cameras 11 is retrieved. The timestamp datamay be analysed and compared to the timeline of video content of aparticular camera so that video content is only retrieved for the timeperiods in which the positioning tag is in the area recorded by aparticular camera. The parts of the content selected at step 7.5 maythen be displayed to a user. In some embodiments, a user may select morethan one positioning tag to be displayed. If it is determined that theuser selected positioning tags that are covered by separate cameras, thetags may be displayed simultaneously in a split screen format. In oneexample, ice hockey players are wearing wearable positioning tags. Auser selects two ice hockey players to be viewed. If it is determinedthat the two players are not covered by the same camera then the twoplayers may be displayed in a split-screen format.

As well as retrieving video content data from cameras covering the areain which the selected tags are located, video content data may also beobtained from cameras adjacent to the camera covering the area in whichthe selected tags are located. This is useful where a tag is highlymobile and may move quickly from one section of the video sphere to anadjacent section.

In scenarios where the positioning tag which is selected by the usermoves between various sectors of the video sphere, video content datamay be retrieved only from the cameras that are covering the areas inwhich the tag is located over a period of time. As such, video contentdata from cameras that do not cover areas in which the tag is locateddoes not need to be accessed.

Embodiments of the invention allow the video/audio and radio-directionrecords to be used to enable viewing or downloading of only a portion ofthe recorded material. The radio-direction information may be based ondetection of a transmitter that is attached to an object (e.g. person,animal or device). Therefore, a video/audio record focus area can bechosen based on choosing the desired radio transmitter identity andother data received from the positioning tags 20. As the user decideswhich of the radio signal objects he or she wants to follow, this object(and its near surroundings) can be streamed for high quality by, forexample, increasing the bit rate for cameras that are covering the tag.Other tags or directions can be streamed with lower quality to savebandwidth and thus improve streaming capability. Furthermore, videostreams from cameras not showing the selected tags may not be downloadedor streamed at all, further saving bandwidth.

A video record of a particular object at a particular time can besearched and viewed efficiently using the identifier and the directionalinformation related with the object. The searching speed may beincreased by using a separate, light-weight file to store the records ofthe directional information. Alternatively, the directional informationmay be stored as part of the video file.

FIG. 9 shows a recording apparatus 90 according to an alternativeembodiment. The recording apparatus 90 comprises a circular array ofrecording devices. In general, the operation of the recording apparatus90 is similar to that of the recording apparatus 10. However, thecircular array is arranged in a single plane so that each of the cameras91 is arranged to capture a section of the three-dimensional spacesurrounding the camera array 90. An example of a camera array capable ofproducing video recordings around 360 degrees is the GoPro 360 cameraarray. Such an arrangement is advantageous in scenarios where the regionto be recorded lies within the recording area of a circular array ofcameras. It should be borne in mind that single plane arrays may coverpartial circle, for example a semicircle.

Table 2 shows an example file that may be compiled during detection ofpositioning tags.

TABLE 2 Azimuth Time angle Identity RSSI Data 00:00:134 281°00:01:02:03:04:05 −73 dBm 01:22:34:56 00:01:023 32° 00:01:02:03:04:05−76 dBm 01:22:34:56 00:01:345 355° 11:01:02:03:04:05 −50 dBm 01:22:34:5700:02:576 101° 00:01:02:03:04:05 −73 dBm 01:22:34:56 00:03:258 23°00:01:02:03:04:05 −67 dBm 01:22:34:56 00:03:753 174° 11:01:02:03:04:05−54 dBm 01:22:34:57 00:03:915 110° 22:01:02:03:04:05 −88 dBm 01:22:34:5800:04:097 303° 00:01:02:03:04:05 −79 dBm 01:22:34:56 00:04:349 224°11:01:02:03:04:05 −56 dBm 01:22:34:57 00:04:436 197° 22:01:02:03:04:05−82 dBm 01:22:34:58

Since all of the cameras 91 are located in the same plane, there is norequirement to collect elevational angle information. As such, the filehas a smaller data size. The controller 92 comprised within therecording apparatus 90 need only perform angle of arrival calculationsto determine an azimuthal angle. Therefore, the processing required bythe controller is lower than in the case where the elevational angle isalso determined.

FIG. 10 shows a recording apparatus 1000 according to yet anotheralternative embodiment. The recording apparatus 1000 comprises an arrayof camera pairs 1001. Each camera pair 1001 comprises a first cameraloom and a second camera 1002 b. The first camera loom is configured tocapture a left-eye image and the second camera 1002 b is configured tocapture a right-eye image. The recording apparatus 1000 comprises acontroller to combine the left-eye image with the right-eye image toform a stereoscopic image. It will be appreciated that the processinginvolved in forming stereoscopic videos is relatively intensive sinceimages must be captured from both cameras of each pair 1001. Subsequentediting of stereoscopic videos is also relatively intensive in terms ofprocessing. The array of camera pairs may be spherical or circular. Fora spherical array both elevational and azimuthal data may be recorded.For a circular array only azimuthal data may be recorded.

In this embodiment, storage of directional data is performed in largelythe same way as previously described.

The controller 1002 may store reference values to allow the azimuthalangle (and, in the case of a spherical array, elevational angle) to bemonitored uniformly. The control module may store information definingthe bearing of zero degrees in azimuth and elevation. From thesereference points, the area covered by a particular camera pair may bedefined. For example, a first camera pair may be defined as coveringazimuthal angular range 0 degrees to 60 degrees and elevational angularrange 0 degrees to 60 degrees. The cameras pair and controller 1002 mayform an integrated recording apparatus wherein the bearing informationis stored in the memory of the cameras and/or controller 1002. Inalternative embodiments, the cameras and/or controller 1002 may beprovided with a compass to determine direction and/or a gyroscope todetermine orientation.

Advantages of various embodiments, especially where the camera array isarranged to record stereoscopic video content, include the ability tomanage feeds having high resolutions. For example, cameras in the arraysdescribed above may have a resolution of up to approximately 6K. Whenediting the feeds from the different cameras it may be necessary toswitch between several high bandwidth feeds. This is especially true, inembodiments having a stereoscopic camera array involving pairs ofcameras. Switching between a large number of feeds at a replay apparatus15 becomes very demanding in terms of bandwidth. Furthermore, if feedsare stored at a remote server and accessed remotely by the replayapparatus 15 over a wireless connection then switching between a largenumber of feeds may become difficult in terms of bandwidth managementand cost. Embodiments provide an advantage that the number of feeds thatneed to be retrieved can be kept to a minimum.

Computer readable instructions, software and operating systems may bepre-programmed into the apparatuses 11, 13, 14, 15, 20, 92, 1002.Alternatively, the computer readable instructions, software andoperating systems may arrive at the apparatuses 11, 13, 14, 15, 20, 92,1002 via an electromagnetic carrier signal or may be copied from aphysical entity 800 (see FIG. 8) such as a computer program product, amemory device or a record medium such as a CD-ROM or DVD. The computerreadable instructions, software and operating systems may provide thelogic and routines that enables the devices/apparatuses 11, 13, 14, 15,20, 92, 1002 to perform the functionality described above.

The term ‘memory’ when used in this specification is intended to relateprimarily to memory comprising both non-volatile memory and volatilememory unless the context implies otherwise, although the term may alsocover one or more volatile memories only, one or more non-volatilememories only, or one or more volatile memories and one or morenon-volatile memories. Examples of volatile memory include RAM, DRAM,SDRAM etc. Examples of non-volatile memory include ROM, PROM, EEPROM,flash memory, optical storage, magnetic storage, etc.

Embodiments of the present disclosure may be implemented in software,hardware, application logic or a combination of software, hardware andapplication logic. The software, application logic and/or hardware mayreside on memory, or any computer media. In an example embodiment, theapplication logic, software or an instruction set is maintained on anyone of various conventional computer-readable media. In the context ofthis document, a “computer-readable medium” may be any media or meansthat can contain, store, communicate, propagate or transport theinstructions for use by or in connection with an instruction executionsystem, apparatus, or device, such as a computer.

A computer-readable medium may comprise a computer-readable storagemedium that may be any tangible media or means that can contain or storethe instructions for use by or in connection with an instructionexecution system, apparatus, or device, such as a computer as definedpreviously.

According to various embodiments of the previous aspect of the presentdisclosure, the computer program according to any of the above aspects,may be implemented in a computer program product comprising a tangiblecomputer-readable medium bearing computer program code embodied thereinwhich can be used with the processor for the implementation of thefunctions described above.

Reference to “computer-readable storage medium”, “computer programproduct”, “tangibly embodied computer program” etc, or a “processor” or“processing circuit” etc. should be understood to encompass not onlycomputers having differing architectures such as single/multi processorarchitectures and sequencers/parallel architectures, but alsospecialised circuits such as field programmable gate arrays FPGA,application specify circuits ASIC, signal processing devices and otherdevices. References to computer program, instructions, code etc. shouldbe understood to express software for a programmable processor firmwaresuch as the programmable content of a hardware device as instructionsfor a processor or configured or configuration settings for a fixedfunction device, gate array, programmable logic device, etc.

By way of example, and not limitation, such “computer-readable storagemedium” may mean a non-transitory computer-readable storage medium whichmay comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage,magnetic disk storage, or other magnetic storage devices, flash memory,or any other medium that can be used to store desired program code inthe form of instructions or data structures and that can be accessed bya computer. It should be understood, however, that “computer-readablestorage medium” and data storage media do not include connections,carrier waves, signals, or other transient media, but are insteaddirected to non-transient, tangible storage media. Disk and disc, asused herein, include compact disc (CD), laser disc, optical disc,digital versatile disc (DVD), floppy disk and Blu-ray disc, where disksusually reproduce data magnetically, while discs reproduce dataoptically with lasers. Combinations of the above should also be includedwithin the scope of “computer-readable medium”.

Instructions may be executed by one or more processors, such as one ormore digital signal processors (DSPs), general purpose microprocessors,application specific integrated circuits (ASICs), field programmablelogic arrays (FPGAs), or other equivalent integrated or discrete logiccircuitry. Accordingly, the term “processor,” as used herein may referto any of the foregoing structure or any other structure suitable forimplementation of the techniques described herein. In addition, in someaspects, the functionality described herein may be provided withindedicated hardware and/or software modules. Also, the techniques couldbe fully implemented in one or more circuits or logic elements.

If desired, the different steps discussed herein may be performed in adifferent order and/or concurrently with each other. Furthermore, ifdesired, one or more of the above-described steps may be optional or maybe combined.

Although various aspects of the present disclosure are set out in theindependent claims, other aspects of the present disclosure compriseother combinations of features from the described embodiments and/or thedependent claims with the features of the independent claims, and notsolely the combinations explicitly set out in the claims.

The invention claimed is:
 1. A method comprising: detecting a userselection of a positioning tag; retrieving directional information fromBluetooth LE positioning messages and timestamp information relating tothe selected tag; comparing directional information relating to theselected tag with directional information of an array of camerasarranged to capture video content from a recording area; identifyingvideo content captured by one or more cameras from the array of camerasarranged to capture video content from a recording area, wherein thevideo content captured by the one or more cameras is identified if theone or more cameras have captured video content from a section of therecording area relevant to the location of the selected tag over a timeperiod relevant to the timestamp information relating to the selectedtag; and selecting the identified video content obtained from the one ormore cameras for display, wherein the array of cameras is one of acircular array of cameras arranged to provide video coverage of an areasurrounding the circular array of cameras across 360 degrees in terms ofazimuth, or a spherical array of cameras arranged to provide videocoverage of an area surrounding the spherical array of cameras across360 degrees in terms of both azimuth and elevation, and wherein thedirectional information comprises at least one of an azimuthal angle oran elevational angle.
 2. The method of claim 1, wherein the selectedpart of the captured video content comprises video content obtained froma camera arranged to cover an area in which the tag is determined to belocated.
 3. The method of claim 1, wherein the selected part of thecaptured video content comprises video content obtained from a cameraadjacent to the camera arranged to cover an area in which the tag isdetermined to be located.
 4. The method of claim 1, further comprisingthe ability to either increasing a bit rate allocated to the selectedpart of the captured video content, or decreasing a bit rate allocatedto the remainder of the captured video content.
 5. The method of claim1, wherein the directional information and timestamp information arestored in a file separate from the captured video content.
 6. The methodof claim 1, wherein detecting a user selection of a positioning tagcomprises detecting a user selection of a plurality of positioning tags.7. The method of claim 6, further comprising causing parts of thecaptured video content comprising video content obtained from thecameras corresponding to the plurality of positioning tags to bedisplayed in a split-screen format.
 8. The method of claim 1, whereinthe video content captured by each camera is captured as part of acomposite data file or in an individual file.
 9. Apparatus comprising:at least one processor; at least one memory having computer-readableinstructions stored thereon, the computer-readable instructions whenexecuted by the at least one processor causing the apparatus at leastto: detect a user selection of a positioning tag; retrieve directionalinformation from a Bluetooth LE positioning message and timestampinformation relating to the selected tag; compare directionalinformation relating to the selected tag with directional information ofan array of cameras arranged to capture video content from a recordingarea; identify video content captured by one or more cameras from thearray of cameras arranged to capture video content from a recordingarea, wherein the video content captured by the one or more cameras isidentified if the one or more cameras have captured video content from asection of the recording area relevant to the location of the selectedtag over a time period relevant to the timestamp information relating tothe selected tag; and select the identified video content obtained fromthe one or more cameras for display, wherein the array of cameras is oneof a circular array of cameras arranged to provide video coverage of anarea surrounding the circular array of cameras across 360 degrees interms of azimuth, or a spherical array of cameras arranged to providevideo coverage of an area surrounding the spherical array of camerasacross 360 degrees in terms of both azimuth and elevation, and whereinthe directional information comprises at least one of an azimuthal angleor an elevational angle.
 10. The apparatus of claim 9, wherein theselected part of the recorded video content comprises video contentobtained from a camera arranged to cover an area in which the tag isdetermined to be located.
 11. The apparatus of claim 9, wherein theselected part of the captured video content comprises video contentobtained from a camera adjacent to the camera arranged to cover an areain which the tag is determined to be located.
 12. The apparatus claim 9,the computer-readable instructions when executed by the at least oneprocessor causing the apparatus comprising the ability to either a) atleast to increase a bit rate allocated to the selected part of therecorded video content, or b) at least to decrease a bit rate allocatedto the remainder of the captured video content.
 13. The apparatus ofclaim 9, wherein the directional information and timestamp informationare stored in a file separate from the captured video content.
 14. Theapparatus of claim 9, wherein detecting a user selection of apositioning tag comprises detecting a user selection of a plurality ofpositioning tags.
 15. The apparatus of claim 9, the computer-readableinstructions when executed by the at least one processor causing theapparatus at least to cause parts of the captured video contentcomprising video content obtained from the cameras corresponding to theplurality of positioning tags to be displayed in a split-screen format.16. The apparatus of claim 9, wherein the video content captured by eachcamera is recorded as part of a composite data file or in an individualfile.
 17. A non-transitory computer-readable storage medium havingcomputer-readable code stored thereon, the computer-readable code, whenexecuted by at least one processor, causing performance of: detecting auser selection of a positioning tag; retrieving directional informationfrom a Bluetooth LE positioning message and timestamp informationrelating to the selected tag; comparing directional information relatingto the selected tag with directional information of an array of camerasarranged to capture video content from a recording area; identifyingvideo content captured by one or more cameras from the array of camerasarranged to capture video content from a recording area, wherein thevideo content captured by the one or more cameras is identified if theone or more cameras have captured video content from a section of therecording area relevant to the location of the selected tag over a timeperiod relevant to the timestamp information relating to the selectedtag; and selecting the identified video content obtained from the one ormore cameras for display, wherein the array of cameras is one of acircular array of cameras arranged to provide video coverage of an areasurrounding the circular array of cameras across 360 degrees in terms ofazimuth, or a spherical array of cameras arranged to provide videocoverage of an area surrounding the spherical array of cameras across360 degrees in terms of both azimuth and elevation, and wherein thedirectional information comprises at least one of an azimuthal angle oran elevational angle.
 18. The non-transitory computer-readable storagemedium of claim 17, the computer-readable code, when executed by the atleast one processor, causing performance of: causing parts of thecaptured video content comprising video content obtained from thecameras corresponding to the plurality of positioning tags to bedisplayed in a split-screen format.
 19. The non-transitorycomputer-readable storage medium of claim 17, wherein the video contentcaptured by each camera is captured as part of a composite data file orin an individual file.